A simple model clarifies the complicated relationships of complex networks 



Bojin Zhen£| 

1 College of Computer Science, South- Central University For Nationalities, Wuhan 430074, China 

2 State Key Laboratory of Networking and Switching Technology, 
•ing University of Posts and Telecommunications, Beijing 100876, China and 

3 School of Software, Tsinghua University, Beijing 100084, China 



Hongrun Wu and Wenhua Du 
1 College of Computer Science, South-Central University For Nationalities, Wuhan 430074, China 



(N 
O 

o 

O: 



> 

(N 

d 



X: 



Jun Qin 

1 College of Computer Science, South-Central University For Nationalities, Wuhan 430074, China and 
2 State Key Laboratory of Networking and Switching Technology, 
Beijing University of Posts and Telecommunications, Beijing 100876, China 



China 



Jianmin Wang and Deyi Li 
3 School of Software, Tsinghua University, Beijing 100084, 
(Dated: Dec. 6, 2011) 



Researchers have discovered many types of complex networks and have proposed hundreds of 
models to explain their origins, yet most of the relationships within each of these types are still 
uncertain. Furthermore, because of the large number of types and models of complex networks, 
it is widely thought that these complex networks cannot all share a simple universal explanation. 
However, here we find that a simple model can produce many types of complex networks, including 
scale-free, small-world, ultra small-world, Delta-distribution, compact, fractal, regular and random 
networks, and by revising this model, we show that one can produce community-structure networks. 
Using this model and its revised versions, the complicated relationships among complex networks 
can be illustrated. Given that complex networks are regarded as a model tool of complex systems, 
the results here bring a new perspective to understanding the power law phenomena observed in 
various complex systems. 



I. INTRODUCTION 

Complex networks have been found to be efRcient and 
effective in illuminating various biological, social, and 
technological systems [11-141 • Through the efforts of many 
scientists, numerous traits of complex networks, such as 
the scale- free property ^Si], the small- world effect 
the community structure 0], and the fractal structure 
have been discovered. 

To explain such traits, hundreds of models have been 
proposed. For example, the Watts- Strogatz (WS) model 
[g| illustrates the origin of the small-world effect and 
demonstrates the relationships of small-world networks, 
random networks and regular networks: i.e., small- world 
networks are a form that is intermediate between random 
networks and regular networks. The Barabasi- Albert 
(BA) model ll| demonstrates the scale-free property of 
networks, and Amaral et al. |.12i] clarified the relationship 
between scale- free networks and small- world networks. Li 
et al. [l3l demonstrated the relationship between scale- 
free networks and random networks through the locality 
hypothesis. Song et al. [H, proposed a method for 
defining fractal networks, which involves the relationship 
between small-world networks and fractal networks. 
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Generally speaking, based on current knowledge, com- 
plex networks can be categorized into many types, such 
as random (l3l. [l3. regular, scale- free, small- world fS, 
ultra small- world [3] , community-structure, compact il5| , 
fractal, and Delta-distribution networks. Moreover, the 
relationships among complex networks have been only 
partially explored. However, the origins of some net- 
works (for example, the community-structure network) 
have not yet been illustrated. Moreover, a navigation 
map is still required to uncover the intrinsic relation- 
ships of complex networks. In fact, such a map can only 
be developed if the origins of all of the relative networks 
are illustrated. 

Considering the number of types of complex networks, 
which is greater than ten, and the hundreds of mod- 
els 0, [13, [H [H, [H-O that have been proposed to 
explain these network types, it is reasonable to believe 
that the many types of complex networks cannot share 
a simple universal explanation: different types of com- 
plex networks originate from different mechanisms; when 
a network has multiple traits, it must have an assem- 
bling mechanism with a set of mechanisms, i.e., the rela- 
tionships are quite complicated and complex. However, 
surprisingly and interestingly, by using only three com- 
mon measures, i.e., the degree of nodes, the degree of 
edges, and the average shortest path, we implemented 
a simple model that can produce random, regular, scale- 
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free, small- world, ultra small-world, compact, fractal and 
Delta-distribution networks. Moreover, with a slight re- 
vision, the model can also produce community-structure 
networks. These results suggest that we can illustrate the 
relationships of various types of complex networks under 
the framework of this model. 

II. RESULTS AND DISCUSSIONS 

A network or graph is a set of nodes with edges between 
them. Regarding the nodes, the degree is the primary 
measurement. Regarding the edges, the concept of edge 
degree has been defined in various ways. In addition to 
characterizing the holistic features of the entire network, 
the average shortest path (i.e., the diameter) is widely 
used [l^. These three measures are the most commonly 
used measures in the study of complex networks. 

It may appear that these measures have no bearing 
on the resultant types of complex networks. However, 
our model shows that there is an intrinsic relationship 
among them. The types are determined by three common 
measures. 



A. The Model 

As mentioned above, the model requires a definition of 
the edge degree. 

Each edge connects two nodes. Because the degree is 
the most commonly used measure of nodes, the degree of 
an edge could be defined as a function of the degrees of 
the two nodes at its ends. Here, the edge degree is defined 
as the product of the power function of the degrees of two 
nodes at both ends (see Fig. 1). 

Based on the definitions above, the proposed model 
can be stated as follows. 

A connected undirected network evolves to 
minimize the summation of the degrees of the 
nodes and to maximize the summation of the de- 
grees of the edges with a constant average short- 
est path. 

That is, every network is evolving and should be opti- 
mized to achieve two objectives with a constraint on its 
diameter. 

Mathematically, this model is expressed by equation 
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y = c 

N > Xi> xmin 

Here, Xi is the degree of node i of the network, y is 
the average shortest path, and c/xmin/a/b/N are non- 
negative constants. Furthermore, xmin is the minimum 
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FIG. 1. Definition of the edge degree, (a) In tlie simplest case, 
the degree of an edge of node A can be defined as 1, regardless 
of the degrees of the nodes at both ends of the edge. Here, 
the summation of the edge degrees of node A is the degree 
of node A. (b) The summation of the edge degrees of node 
A is the summation of the degrees of the neighbors, but does 
not represent the degree of node A itself. Here, regarding 
the nodes on two ends of an edge, the degrees of an identical 
edge relative to the different nodes are different, (c) The 
summation of the edge degrees of node A is the summation 
of the product of the degree of node A and the degree of each 
of its neighbors, (d) The general forms. The degree of an 
edge is the product of the power functions of the degrees of 
its nodes. The previous cases are special cases with different 
values for a and h. 



degree of the nodes throughout the entire network. The 
function 5ij is equal to 1 when a link between node i and 
node j exists; otherwise, it equals 0. 

From the viewpoint of mathematics, the proposed 
model is a bi-objective optimization problem. The pro- 
posed model has feasible solutions of networks, and every 
best solution is a desired resultant network. 

As for single-objective optimization problems, the con- 
cept of "the best solution" is easy to understand. If one 
solution has the largest function value for a maximization 
problem or the smallest function value for a minimization 
problem, then it is one of the best solutions. However, bi- 
objective optimization problems are quite different [20|. 
Commonly, the solution with the best function value for 
the first objective is far from the best for the second ob- 
jective. Therefore, the concept of "the best solution" 
must be extended in bi-objective optimization problems. 

The simplest way to extend this concept is to define 
"the best solution" as "no solution is better at satisfying 
both objectives" . This extended concept often results in 
multiple best solutions. Because none of the best solu- 
tions are dominated by a feasible solution, they form a 
non-dominant set, which is known as the "Pareto front" , 
a term coined by David E. Goldberg [2J] in honor of V. 
Pareto 22] . By the way, another great achievement of V. 
Pareto is the finding of the power law phenomenon in the 
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wealth distribution. For more information on the Pareto 
front, please refer to the SI. 

For any given parameter setting, there is a Pareto front 
for the proposed model. However, for all Pareto fronts, 
the complete network is always an element of each of the 
sets. In the case that the solution is the complete net- 
work, when Fi attains its largest value, F2 also attains 
its largest value. Therefore, no solution dominates the 
complete network. Moreover, when Fi is the smallest, 
the topology of the obtained network depends on the di- 
ameter value. When the diameter value is minimized, 
the topology is a star-like or Delta-distribution network. 
When the diameter value is maximized, the topology is 
a linear regular network (referring to the SI). That is, 
when Fi is the minimum or F2 is the maximum, the so- 
lutions construct the extreme points in the Pareto front; 
here, the network exhibits little randomness, and there- 
fore, the traits of the networks are trivial. The most at- 
tractive case is the middle part of the Pareto front, where 
the network topology does exhibit much randomness. 

With the implementation of different parameters, the 
obtained network would exhibit different traits and would 
correspond to different types. Because theses types are 
obtained for the same model, the origin of these types 
and the relationships of the types can be determined. 



{min fiix^) ^ Xi + {9y ~ c)^ ^ 
min hix,) - 1^ E + {Oy - cf (2) 

s.t. N > Xi > xmin 

Here, 9 is an arbitrary positive real number. 
We use Xi to approximate Xj, so /2 can be further 
rewritten as equation ([3]). 
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Equation ([3]) has an analytic solution of a Pareto front 
[2^ . which can be rewritten as equation when y — 
c, where c does not constraint the random variable X 
through the validation of the network structure. 

f2{x.) = {x,r^'+'^+'^ (4) 

Because /2 is a function that can be defined on the 
sample space, we can obtain equation 



B. Types of networks 



(5) 



Researchers have observed many types of complex 
networks. Here, we discuss the most common types: 
i.e., the scale- free, small- world, ultra small- world, frac- 
tal, community-structure, compact, Delta-distribution, 
random, and regular networks. Here, we theoretically 
demonstrate that these common complex networks can 
be produced by the model described above. Because the 
definitions of various types are not strict and the net- 
works exhibit randomness, some parameters have not yet 
been accurately bounded in relation to the types. 



Scale-free network 



Here, C is a constant to normalize p{X) and satisfies 
the equation 
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Equation ([5]) indicates that under the condition that 
a^O or b^O and when c does not constraint the distri- 
bution of X, i.e., is proper, the network is scale-free, and 
the exponent of the degree distribution obeys equation 



The most popular theoretical description of scale-free 
networks is the BA model [IH. However, if we treat the 
node degree as a random variable, the proposed model 
can also produce scale- free networks. Obviously, some 
scale- free networks are in the Pareto front, while oth- 
ers are not. Here, we demonstrate that the proposed 
model can produce scale-free networks in the Pareto 
front, which we refer to as optimal scale-free networks. 

Here, we treat Xi as samples of the random variable 
X for each solution. Because the samples are indepen- 
dent and identically distributed, based on the Lagrangian 
relaxation method[23|, equation ([1} can be rewritten as 
equation 



7 = 1 + a 6 (7) 

According to the definition of the optimal scale-free 
network, all optimal scale-free networks are the best so- 
lutions to this model. 

Regarding the non-optimal scale-free networks, when 
Fi is fixed, F2 is not optimal: i.e., the important nodes 
are not linked together. When the important nodes 
can be divided into two or more groups, the network 
is called a community-structure network. Thus, the 
non-optimal scale-free networks are actually community- 
structure networks or transitional forms between optimal 
scale-free networks and community-structure networks. 
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2. Community- structure network 

Community-structure scale-free networks can also be 
depicted by this model, with a slight modification. With 
this modification, community-structure scale-free net- 
works become the best solutions of the new model. 

Community-structure scale-free networks are non- 
optimal scale-free networks. Assume that there are two 
identical communities linked by only one edge; when 
some edges in no. 1 community are moved to no. 2, 
F2 of the entire network can increase as the diameter 
decreases, and simultaneously, no. 1 community loses 
some edges, resulting in an increased diameter; that is, 
we can reach a solution that exhibits a large F2 but with 
a fixed c. Therefore, the community-structure scale-free 
networks are non-optimal. 

To produce optimal community-structure scale-free 
networks, the proposed model should be modified. 

In the real world, the community structure often re- 
lates to long distances, such as geographic distances, 
cultural distances or cognitive distances. By taking 
these distances into consideration, optimal community- 
structure scale-free networks can be produced by this 
enhanced model (see the SI). This result indicates the 
origin of the community-structure scale-free networks. 

The modified model can produce typical networks with 
community structures. To address the other non-optimal 
scale-free networks, more constraints must be added. 



3. Compact network and Delta-distribution network 

According to equation ([T]), the diameter of the network 
is a hard constraint, so the constant c can alter the forms 
of the resultant networks. When c does not constrain the 
forms of the networks, we say that c is proper. 

A proper c depends on the constant xmin. From equa- 
tion ([8]), which is the continuous version of the power law 
distribution, when 7 is determined, the probability of X 
depends on the constant xmin, so the proper c would 
decrease as xmin increases. 

xmm \xrain J 

According to the definition of i^2, when some hub nodes 
link to other hub nodes, F2 is maximized. When F2 is 
maximized, if c is proper, because the hub nodes tend to 
link together, the obtained networks would have a single 
center. Because hub nodes are the preferable nodes to 
link together, the obtained network is hierarchical: i.e., 
the obtained network is onion-structure ,25> [2^ or com- 
pact. In such networks, the hub nodes tend to form an 
interconnected core, and the lower the degree of the node, 
the farther the node may be from the center. 

When c is decreased to force the degree distribution 
away from that of a scale-free network, the hub nodes 



collect more edges until the network finally becomes a 
star-like or Delta-distribution network. 



4- Fractal network 

Scale-free networks have a degree distribution of the 
form p{k) ~ According to the definition of self- 

similarity (i.e., when an entire object is exactly or ap- 
proximately similar to a part of itself), scale- free net- 
works can be regarded as self-similar with respect to the 
probability of the degree or can exhibit a probabilistic 
similarity when we treat p{k) as a function. A fractal net- 
work exhibits structural similarity, which is more strict 
than the definition of probabilistic similarity. 

As Song et al. indicated, a fractal network is expected 
to exhibit a power law relationship between the node 
number and the diameter, and this relationship can be 
expressed as equation 

c^N^I^ {l>l) (9) 

Equation (|9]) implies that the diameter should be quite 
large. In fact, because c depends on xmin, the diameter 
of the network should change with xmin. When xmin 
increases, c of the fractal network can be smaller than 
ln{N) when iV is sufficiently small. Here, the qualitative 
relationships of N , xmin, c and I require further investi- 
gation. 

In the proposed model, because c ranges from I to 
iV — I, the diameter of the fractal network must be in- 
cluded. When c is in the ranges of the fractal networks, 
the scale-free networks should be stretched. That is, a 
larger value of c forces some nodes away from the cen- 
ter of network, such that the nodes with higher degrees 
gradually link to the nodes with lower degrees, thereby 
resulting in structural similarity. 

5. Small-world network and ultra small-world network 

The small- world effect exhibits a clear feature in which 
the diameter is approximately ln{N), in addition to a 
larger clustering coefficient 0]. The latter feature is eas- 
ily satisfied. Hence, we discuss the previous feature only. 

According to the definition of the small- world effect, 
when the diameter of the obtained network is given by 
c ~ ln{N), the network is considered a small- world net- 
work. 

Moreover, when c ~ ln{ln(N)), the network is an ul- 
tra small- world one. According to equation ([5]), when 
xmin is sufficiently large, the ultra small- world effect can 
emerge. 

Furthermore, when c changes, the types of networks 
may also changed. That is, when xmin changes, the 
small-world networks can become compact, community- 
structure, or fractal networks. 
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6. Random network 

When a = b = 0, F2 reduces to Fi. Because Fi should 
be minimized and F2 should be maximized, the mini- 
mization of Fi will completely violate the maximization 
of F2 , such that every solution would belong to the Pareto 
front. Therefore, the resulting networks are random if c 
does not constraint the distribution of X. When c is 
small and closes to 1 , the network approximates a Delta- 
distribution network. When c is large, some nodes are 
forced to depart away from the denser center such that 
the degree distribution resembles the power law distribu- 
tion, with the amplitude ranging across several magni- 
tude. 



C. The Simulation 

Having theoretically analyzed the produced types of 
networks, we now discuss the simulation results. 

To solve this bi-objective optimization problem by 
computer simulations, we use multi-objective optimiza- 
tion algorithms. Because Fi is discrete, the histogram 
method 27[ is a suitable approach for transferring this 
problem to a single-objective optimization problem, that 
is, first fix Fi, and optimize only F2. Furthermore, to 
solve F2, we employ a greedy strategy, that is, we ran- 
domly generate a network and then continue to randomly 
change an edge and update the network to a better solu- 
tion. That is, if the change leads to a better F2 and more 
closely approximates the average shortest path, then we 
accept the change; otherwise, we refuse the change. For 
more information on the histogram method, please refer 
to the SI. 

Based on the method above, we obtained various net- 
works using different parameters. Because this optimiza- 
tion algorithm is a type of random algorithm, we per- 
formed this algorithm 5 times to verify its robustness. 
Because all of the runs using the same parameters gen- 
erated similar results, only the results of the first run are 
shown (Fig. 2). 

According to the theoretical analysis, the exponents of 
the degree distribution of the obtained networks depend 
on a and b; therefore, we designed 3 classes of experi- 
ments, with with a = and 6 = 0, a = and 6 = 1, 
a = 1 and & = 1, respectively. Because xmin is re- 
lated to c, we designed 3 sub-classes of experiments, with 
xmin = 1,2,3 for each of the classes. For each subclass, 
we investigated various values of c. Moreover, because 
the simulation algorithm is an iterative method and the 
average shortest paths require a high time-complexity al- 
gorithm, N is set to 300 to enable practical implementa- 
tion of the algorithm. 

From the experimental results, we chose some typical 
results to report in the SI. Here, we selected 6 typical 
networks with 7 = 2(a=0, 6=1); the parameters and re- 
sults are reported in Table 1, and the resultant topology 
is shown in Fig. 2. 



TABLE I. The parameters and results of selected networks 



No. 


E 


c 


xmm 


7 


yl 


(a) 


762 


3.9 


2 


2.10 


3.9 


(b) 


762 


5.5 


2 


2.11 


5.5 


(c) 


762 


7 


2 


2.13 


7 


(d) 


1157 


3.1 


3 


2.16 


3.1 


re; 


1157 4.5 


3 


2.19 


4.5 


(f) 


1157 


5.0 


3 


2.28 


5.0 



E is the fixed value of Fi , 7 is the exponent of the obtained 
network, y is the actual average shortest path of the obtained 
network. 



Fig. 2 shows the compact, community-structure and 
fractal networks. The rows of the sub-figures show the 
effect of c. When c increases, the network type changes 
from compact to fractal. The columns of the sub-figures 
show the effect of xmin. When xmin increases, the net- 
work diameter for the same type decreases. 

Table 1 and Fig. 2 indicate that the obtained networks 
fit well to power law distributions. As shown in Table 1, 
the exponents of the networks are approximately the ex- 
pected values, with the expected average shortest paths. 

Moreover, we observed that the community-structure 
networks exhibit a wide range of values of c because they 
can change the link(s) between the communities to adapt 
to the topological distance. When c is smaller, the link 
can connect the central nodes of the communities; when c 
is larger, the link can connect two marginal nodes in dif- 
ferent communities. For fractal networks, when c reaches 
a certain value, the network is stretched. As c increases, 
the network first exhibits many circles and then becomes 
linear with a head that exhibits thick nodes and edges. 

In general, this model can generate various types of 
networks, including small- world, ultra small- world, scale- 
free, community-structure, and compact networks. Some 
types of the obtained networks are strongly dependent on 
the diameter c . However, because there are no accurate 
definitions for the various types of networks, we cannot 
determine an accurate c for each type from the experi- 
ments; we can only determine the relative relationships 
between the types and the parameters. For more details 
on the results, please refer to the SI. 



D. Relationships 

According to the simulation and theoretical results, the 
relationships of complex networks can be illustrated un- 
der the framework of the proposed model. 

Here, we assume that N = 300, 7 = 2 and show a 
schematic map of the relationships in Fig. 3. When N 
or 7 changes, the schematic map also changes. 

From Fig. 3, we can see that the diameter can be re- 
garded as a spectral line of the network types. Moreover, 
the other parameters affect the network forms. 

Based on the proposed model, the scale-free network 
plays a key and central role, and scale-free networks 
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can be categorized into several classes. First, the scale- 
free networks can be divided into two types, optimal 
and non-optimal. Optimal scale-free networks include 
the ultra small- world, small- world, compact, and frac- 
tal networks, which are controlled by the diameter con- 
straint. Outside of the optimal scale- free networks but 
in the Pareto front, there are the Delta-distribution and 
regular networks. Regarding the non-optimal scale- free 
networks, there are community-structure networks and 
transitional forms between optimal scale-free networks 
and community-structure networks. Moreover, scale-free 
networks can be classified by an exponent. When the ex- 
ponent is larger than 1, the resulting networks are scale- 
free. However, when the exponent equals 1, the networks 
can be random. 



III. CONCLUSION 

In this paper, we demonstrated that a simple model 
can produce many common types of complex net- 
works, including scale-free, small-world, ultra small- 
world, community-structure, compact, fractal, Delta- 
distribution, regular and random networks. Our results 
indicate that three key measures can determine many 
types of complex networks. Moreover, because these 
types originate from the same model, their relationships 
can be illustrated under the framework of the proposed 
model. 

Considering that complex networks are often regarded 
as models of complex systems, the proposed model could 
bring new perspectives to the understanding of complex 



systems. One new perspective provided by the proposed 
model is a new paradigm for distinguishing the expla- 
nations of origins and mechanisms. When the proposed 
model is used to describe a certain complex system, it 
provides only an explanation of the origin and leaves 
the explanation of the mechanism to the optimization 
algorithms. For instance, if we use a genetic algorithm 
to solve the proposed model, then the genetic mecha- 
nism (or evolutionary mechanism) can be regarded as the 
mechanism of the modeled complex system. That is, the 
mechanisms of complex networks/systems can be diverse 
while still representing similar phenomena. Another new 
perspective involves the physical meanings provided by 
the proposed model when applied to complex systems. 
For example, if this model is used to study the scale-free 
property of the Internet or food webs, the meanings of 
Fi and F2 would be very interesting. 
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FIG. 2. Typical networks and their degree distributions. The upper box in each subfigure shows the degree distribution of the 
network in the lower box. The degree distributions are plotted in a log-log coordinate system, (a) This resultant network is 
a compact network, whose c is smaller than ln{N). (b) This resultant network demonstrates a network with two equivalent 
communities, (c) This beautiful network is a fractal network, (d) This resultant network is also a compact network but with 
thicker edges, (e) This resultant network is a community-structure network. Each community has thicker edges, (f) This 
resultant network is a fractal network. 
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complete network small world network 




average shortest path c 

FIG. 3. The schematic map on the relationships among various complex networks. This figure assumes 7=2. When 7 varies, 
this figure would also vary slightly. When c=l, the network is the complete network. When xmin=l, when c increases starting 
fi"om 1, firstly, the network is a delta-distribution network; when c increases continuously, the network is a compact network; 
when c increases continuously, if considering the physical distance, the network can be community-structure scale-free network; 
when c increases continuously, the network is fractal network; when c achieves the maximum, the network is a linear regular 
network; when c=ln{N), the network is a small- world scale- free network, or is community-structure, depending on the physical 
distance. When xmin=2, with the other parameters unchanged, the order of various networks remains the same, but the 
positions in the c spectral line shift left and the ranges decrease; here when c—ln{N), the network is actually fractal. 



